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(54) iUlethod and apparatus for calculating motion vectors 



(57) A motion estimation system for finding motion 
vectors between first and second images selects first 
and second overiapping blocks of pixels from the first 
image. The motion estimation system then estimates 
motion between the first and second Images to define 
respective motion vectors for the overlapping blocks. 
These motion vectors are assigned to respective first 



and second non-overlapping sub-blocks of pixels within 
the respective first and second overlapping blocks of 
pixels. The motion estimation system is advantageously 
used in a video de-interlacing system in whk:h the sub- 
blocks are used to determine whether interpolated sam- 
ples are generated using samples from both the first and 
second image fields or only from the first field. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to a method and 
apparatus for calculating motion vectors and, in partic- 
ular, to a motion vector calculation suitable for use in a 
video de-interlacing system. 

[0002] Digital television (DTV) signals confomiing, for 
example, to the Advanced Television Systems Commit- 
tee (ATSC) standard, may have a large number of for- 
mats. These fomiats are typically referenced by the 
number of horizontal lines in the image and whether 
each image frame is formed from two fields, each con- 
taining altemate lines of the frame (interlaced) or from 
a single image field containing all of the lines of the 
frame (progressive). Listed from highest resolution to 
lowest resolution, the television signal fomnats defined 
by the ATSC standard are referenced by the designa- 
tions, 10801, 720P. 480P and 4801. In these designa- 
tions, the number refers to the number of horizontal lines 
in the image and the letter defines the resulting Image 
as being interlaced (I) or progressive (P). 
[0003] Television receivers that operate according to 
the standard set by the National Television Standards 
Committee (NTSC) display 480 lines of active video in- 
formation as two interiaced fields and, so. have a reso- 
lution of 4801. Most of the existing programming in the 
United States conforms to the NTSC standard. 
[0004] ATSC television receivers may support many 
different types of monitors. An ATSC receiver may, for 
example, be connected to a multi-sync monitor that can 
adapt to display whatever signal type is being received. 
This type of multi-sync monitor is typically refenred to as 
a native mode monitor as it allows each possible type 
of ATSC signal to be displayed at its intended resolution. 
Attemativety, ATSC receivers may be purchased that 
can be connected to a standard NTSC monitor. One 
such receiver is the TU-DST51 DTV Decoder Set-Top 
Box manufactured by Panasonic. This receiver converts 
each ATSC signal type into a 4801 output signal that 
may be displayed on the NTSC monitor. The Panasonic 
receiver also supports the other types of monitors, au- 
tomatically converting the received input signal to the 
format that is supported by the specified monitor. 
[0005] It is well known that interlaced video signals 
have artifacts caused by the interlacing of video fields 
that occur at two different instants. One such artifact is 
vertical dot crawl. This artifact occurs at vertical edges 
in tiie image, typically at edges between portions of the 
image having different colors. As the name implies, the 
vertical dot crawl artifact is seen as a line of dots that 
seem to move from the bottom to the top of the frame, 
if the display device supports progressive video signals, 
these artifacts of interiaced scanning may be removed, 
or at least mitigated, by converting the interlaced video 
signal to a progressive video signal before it is dis- 
played. 



[0006] There are many methods for converting an in- 
teriaced video signal to a progressive video signal. 
Some of these methods are described in a paper by K. 
Sugtyama et al. entitied "A Method of De-interlacing with 
5 Motion Compensated Interpolation," IEEE Transactions 
on Consumer Electronics, Vol. 45, No. 3, 1999 pp. 
611-616. Typically an interiaced video signal is convert- 
ed to a progressive video signal (i.e. de-interiaced) by 
Inserting interpolated image lines between the existing 
10 lines in each image field of the video signal. 

[0007] In motion compensated de-intertacing sys- 
tems, a trade off exists between noise perfomnance and 
small object Tracking. Motion compensation systems 
that use relatively large block sizes typically have good 
ts noise perfonnance, that is to say they do not tend to 
track noise in the image instead of the underiying image 
content. These systems, however, do not tend to track 
small objects well. Thus, if a small object moves in the 
image sequence from one image to the next, a de-inter- 
20 lacing system that uses a large block size may have dif- 
ficulty matching the moved object to the same object in 
the cun-ent frame. If, on the other hand, the block size 
is reduced as in the above referenced article, the small 
object recognition is improved but the noise perfonm- 
25 ance suffers. 

SUMMARY OF THE INVENTION 

P)008] The present invention is embodied in a motion 
30 estimation system for finding motion vectors between 
first and second images. The motion estimation system 
selects first and second overlapping blocks of pixels 
from the first image. The motion estimation system then 
estimates motion between the first and second images 
35 to define respective motion vectors for the overlapping 
blocks. These motion vectors are assigned to respective 
first and second non-overiapping sub-blocks of pixels 
within the respective first and second overlapping 
blocks of pixels. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Figure 1 A is a block diagram of a motion adap- 
tive interiaced scan to progressive scan conversion sys- 

^ tem in acconJance with the present Invention. 

[0010] Figure 1 B is a block diagram of an interiaced 
to progressive converter suitable for use in the conver- 
sion system shown in Figure 1 A. 
[0011] Figure 2A is an image diagram that is useful 

50 for describing the block selection scheme used for mo- 
tion vector calculation by the motion estimation proces- 
sor shown in Figure 1 A. 

[001 2] Figure 2B is an image diagram showing a por- 
tion of the image diagram shown in Figure 2A. 
55 [0013] Figure 3A is an image diagram which is useful 
for describing the motion vector calculation procedure 
used by the motion estimation processor shown in Fig- 
ure 1A. 
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[0014] Figure 3B is an image diagram that shows a 
portion of the image diagram of Figure 3A. 
[0015] Figure 4A is an image diagram which is useful 
for describing the motion vector calculation process 
used by the motion estimation processor of Figure 1 A. 
[001 6] Figure 4B is an image diagram showing a por- 
tion of the image diagram of Figure 4A. 
[0017] Figure 5 is an image diagram which illustrates 
an exemplary process for calculating motion vectors of 
blocks around the edge of any of the images shown in 
Figure 2A through 4B. 

[0018] Figure 6 is a flow-chart diagram that Is useful 
for describing the process of the subject invention. 

DETAILED DESCRIPTION 

[0019] Figure 1 is a block diagram of an exemplary 
interlaced to progressive scan conversion system ac- 
cording to the present invention. In Figure 1 A, an inter- 
laced video signal is received into a current field memory 
1 1 0. As each new field received, the prior contents of 
the memory 11 0 are transfen-ed into a prior field memory 
112. A motion estimation processor 114 is coupled to 
receive video information from both the current field 
memory 1 1 0 and the prior field memory 1 1 2. The motion 
estimation processor 114, as described below, gener- 
ates motion vectors for the current field based on eight- 
by-eight blocks of pixels. The motion vectors, however, 
are applied to four-by-four blocks of pixels. These mo- 
tion vectors are used by the interiaced to progressive 
converter 116 to generate vertically interpolated sam- 
ples between each pair of samples of the interfaced vid- 
eo signal. The cun^entfleld memory 110, prior field mem- 
ory 112, motion estimation processor 114, and inter- 
laced to progressive converter 116 are controlled by a 
controller 118. 

[0020] Although the subject invention is described in 
terms of an exemplary embodiment that generates In- 
terpolated samples for a current field by examining sam- 
ples from a prior field, it is contemplated that it may be 
practk:ed in the context of a current field that generates 
interpolated samples by examining samples from a next 
field or from both a next field and a prior field. 
[0021] The interiaced to progressive converter 116 is 
shown in Figure IB. This converter includes an intra- 
field interpolator 124 and an inter-field interpolator 126. 
The intra-field interpolator 124 vertically averages cor- 
responding samples from adjacent lines In the current 
interiaced field to generate interstitial samples between 
the lines. The Inter-field interpolator 126 filters lines of 
samples from the cunrent field and from the prior field, 
as indicated by the motion vector, to produce interpolat- 
ed samples that are compensated for motion in the im- 
age. When the motion vector generated by the motion 
estimation circuitry 1 1 4 truly reflects motion between the 
current field and the prior field, the interpolated lines 
generated by the Interpolator 126 are preferred as the 
resultant image has greater vertical resolution than if the 



lines from the intra-field Interpolator 124 are used. If, 
however, the motion vectors generated by the motion 
estimation processor are not reflective of true motion be- 
tween fields, the interpolated samples generated by the 
5 inter-field interpolator 1 26 may include motion distortion 
that degrades the quality of the image. In this instance, 
it may be desirable to use the interpolated lines gener- 
ated by the intra-field interpolator 124. 
[0022] In the exemplary embodiment of the invention, 
motion estimation processor 114, shown in Figure 1A, 
applies a difference value to a comparator 1 20 . This val- 
ue is a measure of the difference between the block In 
the current field and the corresponding block in the prior 
field. The comparator 120 compares the difference 
measure to a threshold value provided by a source of 
digital value (e.g. a register) 122. The output signal of 
comparator 120 is supplied to the control input terminal 
of a multiplexer 1 28 which is coupled to receive the intra- 
field Interpolated samples provided by Interpolator 124 
at one signal input port and the con-esponding samples 
provided by the inter-field interpolator 126 at a second 
signal input port. If the difference value provided by the 
motion estimation processor 114 is greater than the 
threshold, the comparator causes the multiplexer 1 28 to 
provide intra-field interpolated samples as the Interpo- 
lated output signal 1 32. If, on the other hand, the differ- 
ence value provided by the processor 114 is less than 
threshold value 122. the comparator causes the multi- 
plexer 128 to provide inter-fletd interpolated samples 
generated by interpolator 126 as the interpolated output 
signal 132. The Interiaced signal of the cun-ent field is 
provided as the interlaced samples 130. Together, the 
samples provided by the signal lines 130 and 132 form 
the progressive video Image. 

[0O23] Figure 2A is an Image diagram that illustrates 
the overiapping large blocks used by the motion estima- 
tion processor 114 to calculate motion vectors. Figure 
2A shows an image 210 and three sets of overiapping 
large blocks defined for the image. These sets of blocks 
are represented, respectively, by solid lines, dashed 
lines, and dotted lines. The first set of blocks 212 are 
defined by the solid lines. These blocks are offset from 
the edge of image 21 0 by, for example, two pixels in both 
the horizontal and vertical directions. Each exemplary 
block 218, as outlined by the lines having alternating 
dashes and dots, includes eight pixels on a side for a 
total of 64 pixels per large block. The second set of 
blocks 214, represented by the dashed lines, is also 
composed of eight-by-eight blocks of pixels. These 
blocks, however, are offset in the horizontal direction by 
six pixels from the left side edge of the image 210 and 
by two pixels from the top edge. The third set of eight- 
by-eight blocks of pixels, represented by the dotted 
lines, is the set 21 6 which is offset from the left side edge 
of the image 21 0 by two pixels and from the top edge of 
the image by six pixels. 

[0024] Figure 2B shows a detailed portion of the im- 
age shown in Figure 2A including the eight-by-eight 
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block of pixels 21 8. As shown in Figure 2B, the blocl< of 
pixels 21 8 is offset from the left side edge of the image 
21 0 by a two pixel interval 228. This block is also offset 
from the top side of the image by a two-pixel interval 224. 
[0025] The exemplary embodiment of the invention s 
uses conventional motion estimation techniques to de- 
fine a motion vector 212 based on the eight-by-eight 
block of pixels 218. This motion vector, however, is ap- 
plied only to a central four-by-four sub-block of pixels 
220. As shown in Figure 2B, this central block ts offset io 
from the top edge of the block 21 8 by a two pixel interval 
226 and from the left side edge of the block 218 by a 
two pixel interval 230. 

[0026] Figure 2B, represents a first step in the motion 
estimation process performed by the processor 114 is 
shown in Figure 1 A. By this process, the motion estima- 
tion processor first defines the block 218 and then cal- 
culates a motion vector for the block by comparing the 
block 21 8 to con-esponding eight-by-eight blocks of pix- 
els from the prior field 1 1 2 that are displaced in position 20 
over a range of pixel positions (e.g. by plus or minus one 
to six pixel positions in each of the horizontal and vertical 
directions). The motion vector con-esponds to the dis- 
placement of the block of the prior image that is within 
the search range and that best satisfies a matching cri- 25 
terion with respect to the block 21 8 in the current image 
210. Exemplary matching algorithms may calculate, for 
example, the mean absolute difference between the 64 
corresponding pairs of pixels in the block. Once the mo- 
tion vector is calculated, however, it is assigned only to 30 
the central four pixel by four pixel sub-block 220. 
[0027] Figures 3A and 3B illustrate a second step in 
the motion estimation process perfomned by the proc- 
essor 1 1 4. In this step, a second eight-by-eight block of 
pixels, 310, is used to generate a motion vector. This 35 
block of pixels is from the group of horizontally displaced 
blocks of pixels 214. As shown in Figures 3A and 3B, 
the block of pixels 310 overlaps the block of pixel 218 
by four pixels in the horizontal direction. As with the 
block of pixel 218, the motion estimation processor 114 40 
generates a motion vector 314 for the entire eight-by- 
eight block of pixels 310 but applies this motion vector 
only to the central four by four pixel sub-block 31 2. This 
block is displaced by two pixels positions in each direc- 
tion from the edges of the block of pixels 31 0. Thus, the 45 
small block 312 is immediately adjacent to the small 
block of pixels 220. 

[0028] The steps shown in Figures 2A and 28; and 
3A and 3B are repeated across the entire width of the 
current image field 210. Figure 4A and 4B illustrate so 
steps that are perfomied by the motion estimation proc- 
essor 114 after the last block along the width of the im- 
age 210 has been processed using the steps illustrated 
by Figures 2 and 3. In the step shown by the Figures 4A 
and 4B, the motion estimation process 1 1 4 takes a block ss 
of samples 410 that Is displaced by four-pixel positions 
in the vertical direction from the top edge of the block of 
samples 218 and, thus, overlaps the lower four lines of 



samples in the block. The motion estimation processor 
114 calculates a motion vector 414 for the entire eight- 
by-eight block of pixels 41 0, but applies this motion vec- 
tor only to the four-by-four central sub-block 412 of the 
eight-by-eight block of pixels 41 0. The four by four sub- 
block of pixels 41 2 is immediately below the four by four 
sub-block 220. 

[0029] The motion estimation process continues us- 
ing a eight by eight block of pixels (not shown) that is 
displaced by four pixel positions in both the horizontal 
and vertical directions from the edges of the blocks of 
pixels 21 8. This block of pixels, thus, overlaps the lower 
one-quarter of the block 21 8 and is used to generate a 
motion vector for a four-by-four block of pixels that is 
immediately below the four-by-four sub-block 312 and 
Immediately to the right of the four-by-four sub-block of 
pixels 412. This process continues across the width of 
the image 210. After the last block of pixels in this sec- 
ond row of pixel blocks has been processed, the motion 
estimation process continues by using the next lower 
block of pixels from the group of pixels 212 outlined by 
solid lines in Figures 2A, 3A, and 4A. 
[0030] The result of the process illustrated by Figure 
2A through 4B is a set of four-by-four blocks of pixels 
each of which has an associated motion vector. The mo- 
tion vector, however, is computed from a larger eight- 
by-eight block of pixels and so exhibits superior noise 
performance. When the motion estimation processor 
1 1 4 applies the four-by-four blocks of pixels to the inter- 
laced to progressive converter 114, It also provides a 
measure of difference between the four by four block of 
pixels from the current field and the matching four-by- 
four block of pixels from the prior field. This measure of 
difference, may for example, be a mean absolute differ- 
ence (MAD) of pixel values or a means squared error 
(MSE) of the pixel values at con'esponding positions in 
the two blocks. 

[0031] Because the motion estimator 114 tracks mo- 
tion in the image based on eight-by-eight blocks of pixel 
values, it tends to track image content and not noise. 
Thus, the estimator 1 1 4 exhibits superior noise perfomi- 
ance compared to a converter that uses a smaller block 
size. In addition, because the measure of difference be- 
tween the matching blocks that is applied to the inter- 
laced to progressive converter 116 is based on the 
small, four-by-four pixel sub-blocks, the converter 116 
is better able to reject false matches of small objects in 
the image than if a larger block size were used. Thus 
the interlaced to progressive converter 1 1 6 exhibits both 
good noise performance and good small object tracking. 
[0032] At the end of the motion estimation process, 
when the last eight-by-eight block of pixels in the image 
has been processed, motion vectors exist for all of the 
blocks of pixels in the image except for a line of four 
pixel by four pixel sub-blocks, that sun^ound the image. 
Motion vectors for these sub-blocks of may be calculat- 
ed in many ways. One example is shown in Figure 5. In 
this Figure, the four-by-four sub-block of pixels 51 0 does 
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not have a motion vector defined by the process de- 
scribed above. In this exemplary embodiment of the in- 
vention, the motion vector 414 calculated for sub-block 
412 is copied as the motion -vector 512 for the four-by- 
four sub-block 510. Similarly the motion vector 222 of 
sub-block 220 is copied as the motion vector 5 1 6 of sub- 
block 514; the motion vector 222 is also copied as the 
motion vector 520 of sub-block 51 8 and the motion vec- 
tor 314 of sub-block 312 is copied as the motion vector 
524 of sub-block 522. Block 526 does not have a cak^u- 
lated motion vector Immediately adjacent along one of 
its edges. In this exemplary embodiment of the inven- 
tion, however, the motion vector 222 is copied as the 
motion vector 528 for sub-block 526. 
[0033] Because the sub-blocks 510, 514. 518. 522, 
and 526 lie along the edge of the Image 210, they are 
less important than blocks more centrally located In the 
image. This is because the viewers attention is typically 
directed to the center of the image and not to the edges 
of the image. Accordingly, the calculation of the motion 
vectors for these blocks is less important than for blocks 
near the central portion of the image. In an alternative 
embodiment of the invention, the motion vectors for 
these blocks may be set to zero. Altematively, some oth- 
er function of the adjacent blocks may be cateulated, for 
example, the motion vector for block 512 maybe calcu- 
lated as an average of the motion vectors 222, 414, and 
a motion vector (not shown) for the four-by-four sub- 
block of pixels (not shown) immediately below sub-block 
412. 

[0034] Although the exemplary embodiments of the 
invention shown in Figures 2A through 5 define a row of 
small blocks around the edge of the image that have 
motion vectors generated by means other than the sub- 
ject Invention, it Is contemplated that this step may be 
omitted. If, for example, the interlaced image is larger 
than the equivalent progressive image, the set of blocks 
212 may be aligned with the top and left edges of the 
image, the set of blocks 214 may be aligned with the top 
and right edges of the image and the set of blocks 216 
may be aligned with the bottom and left edges of the 
image. In this implementation, a border region of, for ex- 
ample, two pixels is defined around the image. If this 
border region may be ignored In the progressive image, 
then no special motion vector step, as shown in Figure 
5, need be implemented. 

[0035] The embodiments of the invention described 
with reference to Figures 1A and 1 B contemplate the 
use of specific hardware circuits to implement the sub- 
ject Invention. It is contemplated, however, that the in- 
vention may be implemented In software for a general 
purpose or special purpose computer The software 
may reside on a computer readable carrier such as a 
magnetic or optical disk or a radio frequency or audio 
frequency carrier wave. 

[0036] Figure 6 is a flow-chart diagram that illustrates 
an exemplary software implementation of the Invention 
that defines two motion vectors for respective overlap- 



ping blocks. These motion vectors define motion be- 
tween the overlapping blocks in a first image and corre- 
sponding overlapping blocks in a second Image. At step 
61 0, the process selects a first block of pixels from the 

5 first image. At step 612, the process searches a prede- 
termined range In the second image for the best match- 
ing block. At step 61 4, the displacement of the matching 
block relative to the first block is set as a motion vector 
for the first block. 

10 [0037] Next, at steps 616. 618 and 620, the above 
process is repeated for the second overlapping block to 
define a second motion vector The final step in the proc- 
ess, step 622 assigns the first and second motion vec- 
tors to respective first and second non-overlapping 

IS blocks taken from central locations In the first and sec- 
ond overlapping blocks. 

[0038] While the invention has been described in 
terms of an exemplary embodiment, it is contemplated 
that It may be practiced as described above within the 

20 scope of the attached claims. For example, while the 
large blocks of pixels in the exemplary embodiment of 
the invention are eight-by-eight pixel blocks and the 
small blocks are four-by-four pixel blocks, it is contem- 
plated that other block sizes may be used. In addition. 

25 it is contemplated that other amounts of overlap may be 
used. The large blocks may be, for example, eight pixel 
by ten pixel blocks and the small blocks may be four 
pixel by six pixel blocks. In addition, while the invention 
has been described in temis of a de-interlacing system, 

30 it is contemplated that it may be used in other systems 
that employ motion vectors such as image compression 
systems and machine vision systems. 

35 Claims 

1 . A method for calculating motion vectors between a 
first image and a second Image, each of the first and 
second images having successive lines of picture 
^ element (pixel) samples, comprising the steps of: 

selecting a first block of N by M pixels having a 
predetemnined position in the first image, where 
N and M are both integers greater than two; 

45 

identifying a first matching block of N by M pix- 
els in the second image, the first matching block 
having a position that is displaced from the po- 
sition of the first block in the first image within 
so a predetemnined range of displacements and 

that matches the first block according to a pre- 
determined criterion; 

calculating a first motion vector as the displace- 
55 ment of the pixel position of the first matching 

block of pixels from the second image relative 
to the position of the first block in the first image; 
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selecting a second block of N by M pixels from 

the first image, the second block overlapping 
the first block In at least O pixel positions, O 
being an integer less than N times M; 

identifying a second matching block of N by M 
pixels in the second image, the second match- 
ing block having a position that Is displaced 
from the position of the second block in the first 
image within the predetemnined range of dis- 
placements and that matches the second block 
according to the predetermined criterion; and 

calculating a second motion vector as the dis- 
placement of the pixel position of the second 
matching block of pixels in the second image 
relative to the position of the second block in 
the first image. 

2. A method according to claim 1 , further including the 
step of assigning the first and second motion vec- 
tors to respective non -overlapping blocks of n by m 
pixels in the respective first and second blocks of 
the first image, where n and m are integers, n being 
less than N and m being less than M. 

3. A method according to claim 2, wherein N and M 
both equal eight, and n and m both equal four. 

4. A method according to claim 1 , wherein the second 
block in the first image is horizontally displaced from 
the first block in the first image. 

5. A method according to claim 4, further including the 
steps of: 

selecting a third block of N by M pixels from the 
first image, the third block being vertically dis- 
placed from the first block and overlapping the 
first block in at least O pixel positions; 

identifying a third matching block of N by M pix- 
els in the second Image, the third matching 
block having a position that is displaced from 
the position of the third block in the first image 
within the predetermined range of displace- 
ments and that matches the third block accord- 
ing to the predetemnined criterion; and 

calculating a third motion vector as the dis- 
placement of the pixel position of the third 
matching block of pixels from the second image 
relative to the position of the third block in the 
first image. 

6. A method according to claim 1 , wherein the second 
block in the first image is vertically displaced from 
the tirst block in the first image. 



10 

7. Apparatus for calculating motion vectors between a 
first image and a second image, each of the first and 
second images having successive lines of picture 
element (pixel) samples, the apparatus comprising: 

5 

means for selecting a first block of N by M pixels 
having a predetenmined position in the first im- 
age, where N and M are both integers greater 
than two; 

10 

means for Identifying a first matching block of 
N by M pixels in the second image, the first 
matching block having a position that is dis- 
placed from the position of the first block in the 
'5 first image within a predetemnined range of dis- 

placements and that matches the first block ac- 
cording to a predetermined criterion; 

means for calculating a first motion vector as 
20 the displacement of the pixel position of the first 

match ing block of pixels from the second image 
relative to the position of the first block in the 
first image; 

25 means for selecting a second block of N by M 

pixels from the first image, the second block 
overlapping the first block in at least O pixel po- 
sitions, O being an integer less than N times M; 

30 means for identifying a second matching block 

of N by M pixels In the second image, the sec- 
ond matching block having a position that is dis- 
placed from the position of the second block In 
the first image within the predetermined range 
35 of displacements and that matches the second 

block according to the predetermined criterion; 
and 

means for cak^ulating a second motion vector 
^0 as the displacement of the pixel position of the 

second matching block of pixels from the sec- 
ond image relative to the position of the second 
block in the first image. 

^ 8. Apparatus according to claim 7, further including 
means for assigning the first and second motion 
vectors to respective non-overlapping blocks of n 
by m pixels in the respective first and second blocks 
of the first image, where n and m are integers, n 

50 being less than N and m being less than M. 

9. Apparatus according to claim 8, wherein N and M 
both equal eight, and n and m both equal four. 

55 10. Apparatus according to claim 7, wherein the second 
block in the first image is horizontally displaced from 
the first block in the first image. 
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11. Apparatus according to claim 10, further including: 

means for selecting a third block of N by M pix- 
els from the first image, the third block being 
vertically displaced from the first block and 
overlapping the first block in at least O pixel po- 
sitions; 

means for identifying a third matching block of 
N by M pixels in the second image, the third 
matching block having a position that is dis- 
placed from the position of the third block in the 
first image within the predetemfiined range of 
displacements and that matches the third block 
according to the predetemnined criterion; and 

means for calculating a third motion vector as 
the displacement of the pixel position of the 
third matching block of pixels in the second im- 
age relative to the position of the third block in 
the first image. 

1 2. Apparatus according to claim 7, wherein the second 
block in the first image is vertically displaced from 
the first block in the first image. 

13. A computer readable earner including a computer 
program that controls a computer to calculate mo- 
tion vectors between a first image and a second im- 
age, each of the first and second images having 
successive lines of pic^re element (pixel) samples, 
the method comprising the steps of: 

selecting a first block of N by M pixels having a 
predetemnined position in the first image, where 
N and M are both integers greater than two; 

identifying a first matching block of N by M pix- 
els In the second image, the first matching block 
having a position that is displaced from the po- 
sition of the first block in the first image within 
a predetermined range of displacements and 
that matches the first block according to a pre- 
detennlned criterion; 

calculating a first motion ve<^or as the displace- 
ment of the pixel position of the first matching 
block of pixels from the second image relative 
to the position of the first block in the first image; 

selecting a second block of N by M pixels from 
the first image, the second block overlapping 
the first block in at least O pixel positions, O 
being an integer less than N times M; 

identifying a second matching block of N by M 

pixels in the second image, the second match- 
ing block having a position that is displaced 



from the position of the second block in the first 
image within the predetermined range of dis- 
placements and that matches the second block 
according to the predetenmined criterion; and 

5 

calculating a second motion vector as the dis- 
placement of the pixel position of the second 
matching block of pixels from the second image 
relative to the position of the second block in 
10 the first image. 

14. A method for converting an interlaced video signal 
having first and second image fields, each having L 
lines of picture element (pixel) samples into a pro- 
fs gressive video signal having corresponding first 

and second image frames, each having at least 2L 
- 1 lines of pixel samples, by adding respective lines 
of interpolated pixel samples between each pair of 
lines of samples of the interiaced video signal, 
20 where L is an integer greater than one, the method 
comprising the steps of: 

selecting first and second overiapping blocks 
of N by M pixels from the first image field, 
25 wherein the first and second blocks overiap by 

O pixels in a predetermined direction, M, N and 
O being integers and O being less than at least 
one of N and M; 

30 estimating motion between the first and second 

image fields to define respective first and sec- 
ond motion vectors for the first and second 
overlapping blocks; 

35 assigning the first and second motion vectors 

to respective first and second non-overiapping 
sub-blocks of pixels in the respective first and 
second blocks of pixel samples; 

^ comparing a measure of difference between 

the first non-overiapping sub-block of pixels 
and a corresponding first matching sub-block 
from the second image, as detenmined by the 
first motion vector, to a predetemnined thresh- 

^ old value to detemnine if the motion vector rep- 

resents true motion between the first and sec- 
ond images; 

generating the interpolated pixel samples using 
50 pixel samples in the first sub-block and the first 

matching sub block if the motion vector repre- 
sents true motion; and 

generating the interpolated pixel samples using 
55 pixel samples in the first sub-block only if the 

motion vector does not represent true motion. 

15. An interlaced scan to progressive scan converter, 
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that converts an interlaced video signal having first 
and second image fields, each having L lines of pic- 
ture element (pixel) samples Into a progressive vid- 
eo signal having corresponding first and second im- 
age frames, each having at least 2L - 1 lines of pixel 5 
samples, by adding respective lines of interpolated 
pixel samples between each pair of lines of samples 
of the interlaced video signal, where L is an integer 
greater than one, the converter comprising: 

10 

means for selecting first and second overlap- 
ping blocks of N by M pixels from the first image 
field, wherein the first and second blocks over- 
lap by O pixels in a predetemiined direction, M, 
N and O being Integers and o being less than ^5 
at least one of N and M; 

a motion estimator which estimates motion be- 
tween the first and second image fields to de- 
fine respective first and second motion vectors 20 
for the first and second overlapping blocks; 

means for assigning the first and second mo- 
tion vectors to respective first and second non-. 
overlapping sub-blocks of pixels in the respec- 25 
tive first and second blocks of pixel samples: 

a comparator which compares a measure 
of difference between the first non-overlap- 
ping sub-block of pixels and a con^espond- 30 
ing first matching sub-block from the sec- 
ond image, as determined by the first mo- 
tion vector, to a predetemiined threshold 
value to determine if the motion vector rep- 
resents true motion between the first and 35 
second images; 

a first interpolator which generates the in- 
terpolated pixel samples using pixel sam- 
ples in the first sub-block and in the first 40 
matching sub block if the motion vector 
represents true motion; and 

a second interpolator which generates the 
interpolated pixel samples using pixel sam- ^ 
pies in the first sub-block only if the motion 
vector does not represent true motion. 

16. A method for cak;ulating motion vectors between a 
first image and a second image, each of the first and so 
second images having successive lines of prcture 
element (pixel) samples comprising the steps of: 

selecting first and second overlapping blocks 
of N by M pixels from the first image field, ss 
wherein the first and second blocks overlap by 
O pixels in a predetemiined direction, M, N and 
O being integers and O being less than at least 



one of N and M; 

estimating motion between the first and second 
image fields to define respective first and sec- 
ond motion vectors for the first and second 
overlapping blocks; and 

assigning the first and second motion vectors 
to respective first and second non-overlapping 
sub-blocks of pixels in the respective first and 
second blocks of pixel samples. 
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